FEB. 28. 2007 1:1 7PM HP LEGAL IP 



NO. 



P. 80 



(19) 



J 



Europaisches Paterrtamt 
European Patent Office 
Office europeen des brevets 



(12) 



01) EP1 173 029 B1 

EUROPEAN PATENT SPECIFICATION 



(45) Date of publication and mention 
of the grant of the patent: 
02.11.2005 Bulletin 2005/44 

(21) Application number. 01117119.6 

(22) Date of filing: 13.07*2001 



(51) IntCI* H04N 9/04, H04N 9/09 



(54) Color Image pickup device 
Farbbildaufhahmegerat 
Appareil de prise de vues en couleurs 



DQ 

CM 
O 

CO 



HI 



(84) Designated Contracting States: 
DE GB 

(30) Priority: 14.07.2000 JP 2000214057 
12.09.2000 JP 2000275993 
30.10.2000 JP 2000330223 
25.09.2000 JP 2000290370 

(43) Data of publication of application: 
16.01.2002 Bulletin 2002/03 

(73) Proprietor: MATSUSHITA ELECTRIC INDUSTRIAL 
CO., LTD. 

Kadoma-shi, Osaka 571-8501 (JP) 

(72) Inventors: 

• Hamasakf, Takeshi 
Yao-shl, Osaka 551-0002 (JP) 



♦ Toyomura, Koichi 
Katano-shi, Osaka 576-0021 (JP) 

• Yano, ShuJ! 

Neyagawa-ehi, Osaka 572-0834 (JP) 

(74) Representative: Grunecker, Kinkeldey, 

Stockmair & Schwa nhausser Anwaltssozietat 
Maximilianstrasse 58 
80538 MUnchen (DE) 



(56) References cited: 
EP-A- 0 476 421 
US^ 5 982 984 



US-A-5 798792 



• PATENT ABSTRACTS OF JAPAN Vol. 1997, ho. 
09, 30 September 1997 (1997-09-30) -& JP 09 
116912 A (MATSUSHITA ELECTRIC IND CO 
LTD), 2 May 1997 (1997-05-02) 



Note: Within nfne months from the publication of the mention of the grant of the European patent, any person may give 
notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in 
a written reasoned statement, It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 
99(1) European Patent Convention). 



Prfrtted Jotnn. 76001 PARIS rt=R> 

PAGE 80/127 * RCVD AT 2/28/2007 4:00:28 PM [Eastern Standard Time] * SVR:USPT0-EFXRF-1/19 * DNIS:2738300 * CSID:16508575487 * DURATION (mm-ss):33-00 



FEB. 28. 2007 1:17PM HP LEGAL IP 



NO. Ill P. 81 



BP 1 173 029 B1 

Description 

[0001] The present Invention relates to an image sensing device such as digital video camera and digital still camera. 
[00D2] As the digital still camera becoming popular recently, the digital video camera originally designed for moving 

5 picture is aJso used in recording of still picture, and in such case the digital video camera is required to record a still 
picture at a picture quality as high as in the case of the digital still camera exclusive for still picture. However^ the DV 
standard for moving picture specifies the number of output pixels of digital video camera. For example, the DV standard 
specifies the number of output pixels of the NTSC system as horizontal 720 pixels x vertical 480 pixels. Therefore, 
the conventional digital video camera, in the case of output of still picture, must generate in this number of pixels (720 

io pixels x 480 pixels). As a result, the picture quality of still picture by the digital video camera is limited at a level 
equivalent to the VGA (640 pixels X 480 pixels). 

[0003] More recently, using a charge coupled device (CCD) of large number of pixels, other digital video camera 
capable of enhancing the picture quality of still picture and recording a moving picture is developed. In this case, when 
taking a moving picture, the digital video camera trims and puts out only part of pixels of the large number of pixels, 

is and issues according to the number of pixels specified in the standard of digital VCR for consumer use (DV standard). 
In such prior arts, when taking a still picture, alt pixels are used, and the picture quality of still picture Is enhanced to 
a level equivalent to XGA (1024 x 768 pixels) or SXGA (1280 X 960 plxels),These prior arts are explained below. 
[0004] Fig- 18 is a block diagram showing configuration of a conventional image sensing device, which fe a sin- 
gle-CCD image sensing device. In the conventional image sensing device, using one CCD of multiple pixels, all pixels 

so of the CCD 1 are used when taking a still picture, and some of the pixels necessary for the moving picture are cut out 
from the COT 1 and used when taxing a moving picture (trimming method). First, when taking a moving picture, the 
image sensing device discards signals corresponding to upper and lower ends of the screen taken by the CCD 1 by 
vertical high speed transfer, and utilizes only signals of vertical 480 pixels corresponding to the central area of the 
screen. Through an analog signal processing unit 2 and A/D converter 3, a matrix circuit 4 processes output signal of 

6 the CCD 1 sequentially, and, as a result, luminance signal (Y signal) and chrominance signal (C signal) are generated 
In the output of the matrix circuit 4. An electronic zoom circuit 5 discards signals corresponding to right and left ends 
of the screen of the outputsignals of the matrix circuit 4, zooms up by a proper magnification factor, and issues horizontal 
720 pixels. Finally, the screen of the moving picture conforms to the DV standard of vertical 480 pixels and horizontal 
720 pixels. When taking a still picture, the conventional Image sensing device Issues ail pixels of the CCD 1 , and if 

so necessary, the electronic zoom circuit executes zoom process, converts into square pixels, and issues still picture 
image signals. 

[0005] In the same configuration as in Fig. 18, the conventional Image sensing device may also process to issue 
pixel signals corresponding to all pixels always from the CCD 1 . In this case, in the moving picture, it is also possible 
to process to issue by shrinking in both horizontal and vertical directions (which is called shrink method). 

& [0006] Generally, the image sensing device of video camera is roughly classified into the single-CCD type and 
three-CCD type according to the unit number of the image sensing devices to use. In the single-CCD image sensing 
device uses one CCD device and it uses a color filter to obtain chrominance signals. The three-CCD Image sensing 
device, by contrast, uses three CCD deviceswhich generate R, G and B signals independently from each CCD. There- 
fore, it has such advantages as a high sensitivity, a high resolution , an excellent tone color, and further a wide dynamic 

*o range as compared with the single-CCD type. Moreover, the three-CCD image sensing device achieves an excellent 
high resolution, by shifting disposition of three CCDs in the two-dimensional position in the horizontal and vertical 
directions by 1/2 pixel each between the CCD for G and CCDs for R and B, that is, by the pixel shifting disposition 
method.. However so far, there is no effective method useful in both still picture and moving picture. 
[0007] in the conventional image sensing device of such configuration, however, has the following problems. 

45 [0008] First, in the trimming method, since only some of the pixels of the CCD 1 are used, the aspect of a picture in 
taking moving image is narrower than in taking still image. 

[Qfit)9] In the shrink method, since all pixels of the CCD 1 are used also in taking moving picture, the aspect of a 
picture is not so narrower as compared with the case in taking still picture,However. in this case, the driving frequency 
of CCD in talcing moving picture is high so as to increase its power consumption. 
so [0010] Further, in both methods, if the number of pixels of still picture is increased without changing the size of the 
optical system, the light receiving area per pixel is smaller, and the sensitivity of the CCD is lowered, and the picture 
quality deteriorates. 

A system for recording digital moving Images of a low resolution and still images of a high resolution is described In 
US-A-5 982 984. The high resolution still image data - comprising about four times more pixels than a low resolution 
as image data - are separated into four parts. Each of the image data comprises the pixels of even or odd rows and even 
or odd columns. Thus, each of the resulting four images can be stored in a format compatible to the format of the 
moving image data. The image data are obtained by three separate sensors for red, green and blue pixels. The sensor 
for the green pixels are displaced in the direction of columns and rows regarding the blue and red pixels. The high 
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resolution still image data are generated by Interpolating the RGB image data. Luminance data are generated from all 
th© generated image data. 

[OOi1] The invention is intended to solve these conventional problems, and it is hence an object thereof to realize 
an advantageous Image sensing device not changed in the aspect of a picture between taking moving picture and 
s taking still picture, capable of suppressing power consumption in taking moving image, and of no decrement ot the 
sensitivity ,by using the optical system of same size. 
[0012] This is achieved by the features of the independent claims. 

Fig. 1 is a block diagram showing an embodiment of an Image sensing device according to the invention, 
iq Fig. 2 is a schematic diagram showing a spatial configuration of pixels when taking a moving picture by using 
interlacing CCDs in the embodiment of the invention. 

Fig. 3 is a block diagram of a matrix circuit used in the embodiment of the image sensing device of the invention. 
Fig. 4 is a conceptual diagram of sampling frequency converting process in the embodiment of the image sensing 
device of the invention. 

75 Fig. 5 is a schematic diagram showing a spatial configuration of pixels when taking a still picture by usl ng interfacing 
CCDs in the embodiment of the invention. 

Fig. 6 is a block diagram of an interlace corrector in the embodiment of the Invention. 

Fig. 7 is a block diagram showing other embodiment of an image sensing device according to the invention. 

Rg* 8 is a block diagram showing a different embodiment of an image sensing device according to the invention. 
20 Fig. 9 Is a block diagram showing another embodiment of an image sensing device according to the Invention. 

Fig. 1 0 is a block diagram showing a further embodiment of an image sensing device according to the invention. 

Fig. 11 is a block diagram showing an interpolation calculating circuit In the embodiment of the invention in Fig. 10. 

Fig. 12 is a vertical frequency characteristic diagram of R and B signals in still picture taking issued from the 

interpolation calculating circuit in Fig. 11. 
25 Fig. 1 3 is a vertical frequency characteristic diagram of G signal issued from the interpolation calculating circuit in 

Fig. 11. 

Fig . 1 4 is a vertical frequency characteristic diagram of R, G, and B signals entered in the interpolation calculating 
circuit In Fig. 11 . 

Fig. 1 5 is a schematic diagram showing a spatial configuration of pixels in moving image taking in the embodiment 
30 of the invention In Fig. 10. 

Fig. 16 is a vertical frequency characteristic diagram of R and B signals in moving picture taking issued from the 
interpolation calculating circuit In Rg. 11 . 

Fig. 1 7 is a diagram showing other example of the interpolation calculating circuit 
Fig. 18 is a block diagram of a conventional image sensing device. 

35 

[0013] The image sensing device of the invention generates two luminance signals deviated vertically in space by 
1/2 of the CCD vertical pixel interval, from the signals being read out from plural CCDs having the pixels shifted in an 
oblique direction. When taking a stilt picture, the two luminance signals are used as output signals, and when taking 
a moving picture, only one of the two luminance signals is used as output signal after sampling frequency conversion. 
40 [0014] Referring now to the drawings, preferred embodiments of the invention are described beiow. 

[001 SI Fig. 1 is a block diagram showing an embodiment of an image sensing device according to the invention. 
CCDs 101 to 103 are interlacing CCDs for R, G, and B, respectively. Finst, the operation In moving picture taking mode 
Is explained. For the sake of simplicity in explanation, in the CCD. it is supposed that the mutually adjacent vertical 
pixel signals are not added up. 

45 [0016] An analog processing unit 2, and A/0 converters 301 , 302, and 303 respectively process the R signal, G 
signal, and B signal Issued from the CCDs 101, 1 02, and 103, and convert into digital signals. A matrix circuit 401 
processes the outputs from the A/D converters 301 , 302, and 303, or R signal, G signal, and B signal from first memory 
means d, and converts from these signals of three lines into two luminance signals Y1 and Y2 and one chrominance 
signal C. The operation of this matrix circuit 401 is shown below. 

so [0017] Rg. 2 shows a spatial configuration of pixels of interlacing CCDs 101 , 102, end 1 03. In the case of using 
interlacing CCDs, the diagram shows a spatial configuration of pixels {indicated by circles) corresponding to R, G. and 
B signals in moving picture taking. By the pixefs arranged in obliquely shifted disposition, G signal pixels G 11 , G 12 , G 13 
are deviated, respectively, from R and B signal pixels R 1lP Ft^, R-, 3 , and B 1T , B 12 , B lS by the portion of 1/2 pixel obliquely 
in a lower right direction, that is, by Ph/2 in the horizontal direction, and PW2 in the vertical direction. Herein, since the 

55 CCDs 1 01 , 1 02, and 1 03 are interlacing CCDs, at the time of signal output pixels of G signals are read out in every 
other vertical pixel, that is, G ni , G 31 , G 51 (notshown) in the odd field, and G 21 , G^, (not shown) in the even field. 
It is the same in R signal and B signal. 

[0018] The matrix circuit 401 processes these R, G, and B pixel signals sampled at sampling frequency fs according 
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to the matrix formula (formula 1). and obtains the value of Y signal of pixels Y1 21 , Yt^, .... This value, as Y1 signal, 
is sampled at double frequency 2fs, and Issues to a next circuit. 

^ [formula 1] 

Y1 31 =O.30R 31 +0.59G 31 +0. 1 1 B 31 
Y1 a2 =O.30R 32 +O.59G 31 +0.1 1 

ID 

[0019] Thus, the matrix circuit 401 determines the Y1 signal of each pixel, and obtains Y signals Y1 31 , Y^, YI33, 
Y1 34* Y1 35> - 0 ndic 9ted by black spot) corresponding to a double number of pixels of G in the horizontal direction. For 
example, supposing the R, G, and B image sensing elements to have horizontal 768 pixels, the Y1 signal is a signal 
corresponding to horizontal 1536 pixels. At this time, assuming fs = 15.75 MHz, the sampling frequency 2fs of output 
is signal is 2fs = 31 ,5 MHz. 

[0020] Similarly, the C signal is obtained as shown in formula 2. 

[formula 2] 

20 C 31 =0.70Rm-a59<3 31 -0.1 1 Bm 

c &*° 30Rm^.59G 91 +0.89Bm 

25 where 

Rm=(R 31 +R3^R 5l +Rs2)/4 
Bm=(8 3l +B 32 +B 51 +B 5 gy4 

[0021] Rg. 3 shows an internal structure of the matrix circuit 401 . The matrix circuit 401 receives an R signal, and 
feeds it into a 1H line memory 11 (H; one scanning period in horizontal direction), and a C matrix circuit 17. Similarly, 
30 the matrix circuit 401 receives a 8 signal, and feeds It into a 1 H line memory 1 2, and the C matrix circuit 1 7. The 1 H 
line memory 11 feeds its output into a Yl matrix circuit 15 and a Y2 matrix circuit 1 6. Similarly, the 1 H line memory 12 
feeds its output into the Y1 matrix circuit 15 and Y2 matrix circuit 16. 

[0022] On the one hand, the matrix circuit 401 receives a G signal, and feeds it into a 1H line memory 13, and the- 
1H line memory 13 feeds its output into the Y1 matrix circuit 15, a C matrix circuit 17, and a 1H line memory 14. The 

35 l H line memory 1 4 feeds its output into the Y2 matrix circuit 1 6. 

[0023] The luminance signal Y1 matrix circuit 15 receives red pixel signals fi^R^, blue pixel signals B^, 
and green pixel signals G 31 , G 32f .... respectively, from the 1 H line memory 11, 1H line memory 1 2, and 1 H line memory 
13, and processes according to formula 1 so as to generate a luminance signal Y1. The other luminance signal Y2 
matrix circuit 16 receives red pixel signals R 31 , R^, ... f blue pixel signals B^, B^, .... and green pixel signals G l1f 

40 G 12 respectively, from the 1 H line memory 11, 1H line memory 1 2, and 1 H line memory 1 4, and processes according 

to formula 1 so as to generate a luminance signal Y2. The chrominance signal C matrix circuit 17 recievee red pixel 

signals R51 , R52,..., blue pixel signals B51 , 652,-. and 1 H delayed signals of red pixel signals R31 ,R32 blue pixel 

signals B31 , B32,..., and green pixel signals G31 ,G32,...> from the R input, B input, the 1 H line memory 11, 1H line 
memory 12, 1H One memory 1 3, respectively, so as to process them according to formula 2 to generate a chrominance 

45 signal C, 

[0024] A horizontal zoom circuit 501 (shown as H zoom circuit in Figs. 1 , 7, 8, 9, and 1 0) zooms the luminance signals 
Y1 and Y2 and chrominance signal G generated from the matrix circuit 401 for adjustment of aspect of a picture. In 
the case of the DV standard, the camera output In taking moving picture must produce the Y signal of horizontal 720 
pixels and vertical 480 pbcels at a sampling frequency of 13.5 MHz. However, the driving frequency of CCD is generally 

so different from 13.5 MHz, and it fs necessary to convert the sampling frequency as described beJow. Herein, in order 
that the number of pixels after sampling frequency conversion may be horizontal 720 pixels, the ratio of number of 
horizontal pixels before and after conversion is set equal to the ratio of conversion of sampling frequency. For example, , 
to convert the Y signal of horizontal 1 536 pixels, vertical 480 pixels, and sampfing frequency of 31 £ MHz, into a signal 
of horizontal 720 pixels, vertical 460 pixels, and sampling frequency of 1 3.5 M Hz, since the frequency ratio is as shown 

ss in formula 3, the zoom factor is as shown in formula 4. 

[formula 3] 
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Before conversion : after conversion =31.5 : 13.5=1680 : 720 



[formula 4] 
Zoom factor = 1 680/1 536=1 ,093 times 

[0025] A sampling frequency converter 6 converts the sampling frequency in the horizontal direction, in relation both 
10 to the luminance signal Y1 and chrominance signal C issued from the horizontal zoom circuit 501 . This mode is shown 
In Fig- 4. 

[0026] Fig. 4 is a conceptual diagram of sampling frequency conversion of luminance signal Y1 . The diagram shows 
an example of converting the sampling frequency by 3/7- , Y 2 , ... are signal values of pixels corresponding to the 
luminance signal Y1 before conversion, and Y^, Y a \ ... are signal values of pixels of the Yj signal after conversion. 

is The sampling frequency converter 6, first on based on the pixel of signal Y1 , limits the band of the luminance signal 
Y, before conversion, and determines the signal value YV existing at the same position as the pixel Y v Next, the 
sampling frequency converter 6 limits the band of signal for Y 2 ' corresponding to the position at distance of 1 :2 from 
pixels of signals Y 3 and Y 4 , respectively, and calculates the signal value Y 2 ' by interpolation. Similarly the sampling 
frequency converter 6 limits the band of signal for Y 3 ' corresponding to the position at distance of 2:1 from pixels of 

20 signals Y 5 and Y 6 . respectively, and calculates the signal value Yg by interpolation. After the sampling frequency 
converter 6 repeats the operations for the other sampling points, and then it lowers the sampling frequency in the 
horizontal direction by 3/7. As a result, the sampling frequency converter 6 converts the luminance signal Y1 of hori- 
zontal 1 6BO pixels and sampling f req uency of 31 .S MHz, into a luminance signal Y1 of horizontal 720 pixels and sampling 
frequency of 13.5 MHz. Conversion of sampling frequency of chrominance signal C is of the same concept, and its 

& explanation Is omitted. 

[0027] The output of the sampling frequency converter 8 is put into a selector 7. The selector 7 selects and issues 
a moving picture signal or still picture signal, in moving picture taking, the selector 7 selects the output of the sampling 
frequency converter 6, and the luminance signal Y1 and chrominance signal C of moving picture signal are issued. 
[0028] The mode of still picture taking is explained below. 
30 [0029] Fig. 5 shows a spatial configuration of pixels corresponding to R, G, and B signals when taking a still picture 
by using Interlacing CCDs. 

[OQ30] In Fig. 5, R signals, G signals , and B signals are indicated by circles, and first luminance signals Y1 and 
second luminance signals Y2 are indicated by black spot. Fig. 5 is different from Fig. 2 only in that second luminance 
signals Y2 are provided, but is similar to Fig. 2 in other aspects. 

3$ [0031] The R, G, and B signals in the spatial configuration are scanned sequentially in every other pixel in the vertical 
direction from the CCD, as shown in Fig. 5. Pixels of G signals, for example, is scanned vertically in the sequence of 

G 11t G 91 during oddfiefds, and is scanned vertically in the sequence of G 21 , G 41? ... , during even fields. R signals 

and B signals are similarly scanned. That is, since signals of all pixels of the CCD cannot be scanned during one field 
period, they must be scanned during two field periods. Herein, the CCDs 101 to 103 feed these R signals, G signals, 

40 and B signals into first memory means 8 through the analog processing unit 2 and A/D converters 301 , 302, and 303, 
during two field periods. As a result, the first memory means 8 memorizes the R signals, G signals, and B signals of 
all pixels. 

[0032] The first memory means 3, for example in the case of pixels of G signals among RGB , issues G signals G nil 
G S1 ,G31,G 41| ... in turn .towards the vertical direction, so as to reproduce the spatial disposition on the CCD. Rsignals 
4? and B signals are issued similarly to the G signals. The first memory means 8 feeds Its output into the matrix circuit 401 . 
[0033] The matrix circuit 401 receives ft, G, and B pixel signals from the first memory means 8 at the sampling 
frequency fe, calculates, according to formula 5, luminance signals Y 11t Y 12 , ... for respective pixels from signals R 21 , 
R^, ... of red pixel R, signals G 21 , G22, - of fl fBen Pi* el G » ^ signals B 21> B^, ... of blue pixel B, so as to generate 
them as first luminance signal Y1 at sampling frequency 2fs. 

so 

(formula 5] 
Y1 21 =0.3QR 21 +0.590^+0.1 18^, 

55 yi ^o^or^+o^g^ +0.1 1 

[0034] Similarly, the matrix circuit 401 receives R. G. and B pixel signals from the first memory means 8 at the 
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sampling frequency fe, calculates, according to formula 6, luminance signals Y2 11( Y2 12 , ... of pixels from signals R 2 i» 
R22, ... of red pixel R, signals G^, G 12 , ... of green pixel G, and signals B^, ... of blue pixel B t so as to generate 
them as second luminance signal Y2 at sampling frequency 2fs. 

5 

[formula 6] 
Y2 11 =G.30R 2 i+°-^G 11 +0.11B 21 
Y2 l2 =0.30R 22 +0.59e 11 +0.11S 22 

[0035] Thus, the matrix circuit 401 can obtain Y signate having a double number of pixels of the green pixels <3 to 
the horizontal direction. Further, combining the first luminance signal Y1 and second luminance slgnaJ Y2, Y signals 
having a double number of pixels of the green pixels G are also obtained to the vertical direction. For example, in the 

15 case of each of R, G, B CCDs having horizontal 768 pixels and vertical 480 pixels, the matrix circuit 401 generates 
both first luminance signal Yl and second luminance signal Y2 each having horizontal 1536 pixels and vertical 480 
pixels. When the first luminance signal Y1 and second luminance signal Y2 are combined, the luminance signaj Y of 
still picture is a signal of horizontal 1536 pixels and vertical 960 pixels. At this time, supposing the original sampling 
frequency fs to be 15.75 MHz, the output sampling frequency 2fs is 31.5 MHz. 

20 [0036] On the other hand, the chrominance signal Q is obtained only in one set of chrominance signal based on 
formula 7. As the human visual discrimination of color is not ©o high as that of luminance, in other words monochrome, 
multiple pixels enhancement are not needed, and it is enough to have one set of chrominance signal based on formula 
7. As the position of chrominance signal C is same as that of green G signal, so it is not shown in Fig. 5. 

[formula 7] 
C 21 =0.70Rm-0.59G 21 -0.1 1 Bm 
^ C 22 -0.30RrtV0.59G 21 +0.B9Bm 

where 

Rrn=(R2 1 +R2^Ffe 1 +R 3 2)A* 
Bm={B 21 +B22+B3 1 +B 32 y4 

& [0037] The horizontal zoom circuit 501 converts the output pixel signal of the matrix circuit 401 into square pixel 
signaf. This square pixel conversion is explained. Generally, the CCD for digital still camera has an equal pixel interval 
between the horizontal and vertical directions . This arrangement Is called as square pixel arrangement. 
[0038] By contrast, the CCD for video camera differs in the pitch of pixels, and generally the pitch of the horizontal 
directions is shorter than that of the vertical direction. Therefore, when such CCD signals by the video camera are 

40 directly displayed In the personal computer screen which displays an image lengthend in the lateral direction, in other 
words, an image shortened in the vertical direction. 

[0039] Accordingly, in this case, it is necessary for the horizontal 200m circuit 501 to zoom the image electronically 
in the horizontal direction, and to adjust the pitch of horizontal pbrsls to be equal to that of vertical pixels both for the 
luminance signal Y and for the chrominance signal C, so as to be in square pixel arrangement on the personal computer 
• 45 screen. In other words, it is therefore necessary to adjust the ratio of the number of pixels in the horizontal and vertical 
direction at 4;3 so that the square pixel arrangement may conform to the personal computer screen with the aspect 
ratio of 4:3. In the case of CCD of the luminance signal Y of horizontal 1 536 pixels and vertical 9S0 pixels, the horizontal 
zoom circuit 501 zooms in the horizontal direction by about 0,83(=1 280/1536) times, so as to obtain an image signal 
of square pixels, consisting of horizontal 1280 pixels and vertical 960 pixels. 
so [0040] The second memory means 9 memorizes output signals of the horizontal zoom circuit 501 . As a result, the 
second memory means 9 memorizes Y and C signals after square pixel conversion, that te, Y1 , Y2, and C signals 
having horizontal 1280 pixels and vertical 480 pixels. 

[0041] The second memory means 9 generates the first luminance signal Y1 and second luminance signal Y2 alter- 
natively, in such way that at first it generates the second luminance signal Y2 positioned higher in space, and then 

ss generates luminance signals Y for the portion of vertical 960 pixels in the sequence of Y2, Yl, Y2. Y1. Y2, 

alternatively .for every scanning lines. This sequence of the luminance signal is put into the selector 7. 

[0042] On the other hand, the chrominance signal C (or C signal) from the second memory means 9 Is put into an 

interface corrector 10. 
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[0043] The interlace corrector 10 interpolates the C signal of vertical 4S0 pixels in the vertical direction, so as to 
generates C signal of vertical 960 pixels. 

[0044J Fl 9- 6 shows an internal structure of the interlace corrector 1 0. 

[0045] The interlace corrector 10 receives a C signal, and feeds it Into a 1H line memory 21, an adder 22, and a 

5 selector 24. The 1 H line memory 21 delays the C signal by 1 H period, Tlie adder 22 adds the input C signal and the 
C signal delayed by 1 H period. A divider 23 divides the summed signal by 2, and puts the results into the selector 24, 
The selector 24 selects either one of the input C signal or output signal of the divider 23 In every 1 H period and issues 
selected one. The output C signal of the interlace corrector 10 is put into the selector 7. 

[0046] The selector 7 selects the output of the second memory means 9 and the output of the Interlace corrector 1 0 
f<> in taking still picture, and issues the still picture image signal as camera output. As a result, image signal outputs of 
still picture are luminance signal Y and chrominance signal C of horizontal 1280 pixels and vertical 960 pixels. 
[0047] Having such configuration, the embodiment is advantageous in the following points: the output image signal 
is not changed in the aspect of a picture between the taking moving picture mode and taking still picture mode; the 
CCD driving frequency is equalized between the taking still picture mode and taking moving picture mode; by parallel 

6 processing of the first luminance signal Y1 and second luminance signal Y2, the sampling frequency is equalized 
between the taking still picture mode and fating* moving picture mode, so that the power consumption can be sup- 
pressed; by stopping the driving signal for processing of second luminance signal Y2 that is not necessary in taking 
moving picture mode, the power consumption can be further saved; and In the three-CCD system of the invention, the 
number of pixels of the each CCD necessary for still picture is only 1/4 compared w'rth that of the single-CCD system. 

so As a result, in the optical system of a same size, the pixel area can be increased up to 4 times compared with the pixel 
area of the single-CCD system, so the image sensing device of the invention is advantageous in the aspect of the 
sensitivity, or, the S/N ratio. In other words, when the sensitivity is the same, the size of tfie optical system can be small 
one, so that the total device can be small In size. 

[0048] In this embodiment, in taking moving picture, adjacent vertical pixels are not driven simultaneously in inter- 
as lacing CCDs, but when driving adjacent vertical pixels simultaneously, same effects are expected by driving and 
G31 and <3 41 , ... simultaneously in odd fields, and driving and G ai , G 41 and G 51> ... simultaneously in even 
fields. 

[00491 The first memory means a and second memory means 9 are not always required to be separate ones, but 
these memory means may be realized by one memory means having two different regions for each memory means. 

so [0050] Thus, when using interlacing CCDs, signals of ail pixels cannot be issued within one V period (V; vertical 
scanning period), but signal of all pixels are Issued In twice period of 2V. Accordingly, in taking still picture, in order to 
avoid difference In the pixel signal level issued In the first V period and second v period, the CCD must be shielded in 
the 2V period for issuing the pixel signal from the CCD. Accordingly, rt may be required to use a diaphragm for a shutter 
for the purpose of shielding. However, use of mechanical shutter is not advantageous in the speed of successive multi- 

35 image taking. Accordingly, the following configuration may be considered for better eolusion, 

[0051] Fig. 7 is a.block diagram showing other embodiment of the Image sensing device. Herein, CCDs 111, 112, 
and 113 are progressive CCDs for R, G and B. 

[0052] An analog processing unit 2, and A/D converters 301, 302, and 303 process the R signal, G signal, and B 
signal issued fmm the CCDs 111, 112, and 113, and convert into digital signals, respectively. A matrix circuit 401 
4Q processes the outputs from the A/D converters 301, 302, and 303, and R signal, G signal, and 6 signal from first 
memory means 8, so as to converts these three RGB signals into two luminance signals Y1 and Y2 and one chromi- 
nance signal C. The operation of this matrix circuit 401 is shown below. 

[0053] A matrix circuit 401 , same as in the embodiment in Fig. 1 , calculates and issues first luminance signal Y1 and 
second luminance signal Y2 according to formula S and formula 6, and chrominance signal C according to formula 7, 
4$ from R signal, G signal, and B signal at the respective positions in two dimensional space shown in Rg. 5. As the 
structure and operation of the matrix circuit 401 are same as In the embodiment In Fig. 1 , as shown In Rg. 3, so their 
explanations are omitted. 

[0054] Since the CCDs 111 , 112, and 113 are progressive CCDs, pixels of G signals issued from these CCDs are 
deviated by 1/2 pixel from the pixels of R signals and B signals both in horizontal direction and in vertical direction. 

so Therefore, unlike the case of interlacing CCDs, rt is not necessary to store the outputs from the CCDs 111, 112, and 
1 13 once in the memory means before putting into the matrix circuit 401 . Moreover, since the CCDs 11 1 , 112, and 113 
issue signals of all pixels during 1 V period, It is not necessary partly to shield the CCDs from light leakage, and then 
the shutter mechanism as in the case of Fig. 1 is not needed. At this time, the positions of the first luminance signal 
Y1 and second luminance signal Y2 in two dimensional space are same In Rg. 5. As the position of C signal Is same 

& as that of G signal in Rg. 5, so position of C signal is not hence shown in the diagram. 

[0055] A horizontal zoom circuit 501 processes the output of the matrix circuit 401 by horizontal zooming to match 
the aspect of a picture in taking moving picture and to match square pixels in taking still picture, similar to the embod- 
iment in Fig. 1 . The output of the horizontal zoom circuit 501 is put into a sampling frequency converter 6 and second 
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memory means 9. 

[0056] The sampling frequency converter 6 converts the sampling frequency in taking moving picture same as in the 
embodiment in Fig. 1. 

[0057] Supposing the number of pixels of the progressiva CCDs 111 > 112, and 113 to be horizontal 768 pixels and 
5 vertical 480 pixels with their driving frequency at 31 .5 MHz, the matrix circuit 401 issues a signal of horizontal 1 536 
pixels having sampling frequency of 63 MHz. At this time, the horizontal zoom circuit 501 issues a signal of horizontal 
1680 pixels having sampling frequency of 63 MHz, and the sampling frequency converter S obtains a progressive video 
ouiput of horizontal 720 pixels having sampling frequency of 27 MHz. 

[0058] The second memory means 9 memorizes output signals of the horizontal zoom circuit 501 for square pixel 

10 conversion In taking still picture. As a result, the second memory means 9 obtains,after square pixel conversion, the 
first luminance signal Y1 , second luminance signal Y2, and c signal in horizontal 1 280 pixels and in vertical 480 pixels. 
[0059] Thesecond memory means 9 issues the first luminance signal Y1 and second luminance signal Y2 alternately, 
in other words, issues first the second luminance signal Y2 positioned higher in vertical position, and then issues 
successively luminance signals for the position of vertical 960 pixels alternately in the sequence of Y2, Y1, Y2, Y1 . 

*s Y2, „,„ These outputs are put into a selector 7. 

[0080] On the other hand, the C signaJ output from the second memory means 9 is put into an interlace corrector 1 0. 
[0061] The interlace corrector 1 0, same as in Fig. 1 , interpolates the C signal of vertical 480 pixels in the vertical 
direction, so as to issues a double C signal of vertical 960 pixels. The selector 7 is same as in Fig, 1 As the structure 
and operation of the interlace corrector 10 are same as the structure and operation in the embodiment In Fig. 1, as 

20 shown in Fig. 6, so the explanation of it is omitted. 

[0062] In the taking still picture mode, the selector 7 selects the output of the memory means 9 and the output of the 
interlace corrector 10, so as to issue a still picture image signal as camera output As a result, the still picture image 
signal output is composed of luminance signal Y and C signal of horizontal 12B0 pixels and vertical 960 pixels, so that 
a high-definition still picture signal Is obtained. 

25 [0063] In this configuration, as the image sensing device does not require shutter mechanism or other CCD shielding 
means in taking stili picture, so this configuration can realize to use signals of all of the pixels of CCDs in taking still 
picture. Moreover, the image sensing device can much enhance the taking speed of successive multi image in taking 
still picture. Further, in taking moving picture, the Image sensing device obtains a progressive moving picture output 
having high picture quality. 

so [0064] As mentioned herein, in this image sensing device, the CCD for G is arranged in a shifted disposition from 
the CCDs for R and B in horizontal direction and vertical direction, and it also generates two lines of Y signals having 
a double number of pixels of R, G, B in the horizontal direction, and corresponding to the position shifted by 1/2 pixel 
in the vertical direction, by parallel processing. As a result, the image sensing device issues two luminance signals Y1 
and Y2 in taking still picture, and Issues only one set of luminance signal Y1 in taking moving picture by converting the 

ss sampling frequency. 

[0065] Hence, the image sensing device of the embodiment has the following advantages: the aspect of a picture is 
not changed between the taking moving picture mode and taking still picture mode; the CCD driving frequency Is 
equalized between the taking still picture mode and taking moving picture mode; the driving frequency Is not so high 
that the power consumption Is suppressed; in the three-CCD system of the invention, the number of pixels of CCD 

ao necessary for still picture is 1/4 compared with that of the single-CCD type; As a result, in the optical system of a same 
size, the pixel area can be increased up to 4 times compared with the pixel area of the singte-CCD system, and it is 
advantageous in the aspect of the sensitivity, or, the S/N ratio; In other words, when the sensitivity is the same, the 
size of the optical system can be small one, so that the device can be small In size. In the image sensing device of the 
embodiment in Fig. 7, since the progressive CCDs are used for RGB CCDs, in addition to the benefits of the embodiment 

as in Fig. 1 , such following merits are obtained: that the Image sensing device does not require CCD shielding means; 
and, as a result, that the image sensing device of Fig, 7 can much enhance the taking speed of successive multi-image 
in taking still picture. 

[0066] In these two foregoing embodiments, the image sensing device is designed to select either the signal for 
moving picture or the signal for still picture by using the selector 7, but the image sensing device may be also designed 
so to process the signal for moving picture and the signal for still picture independently. 
[0067] Fig. 8 is a block diagram of such embodiment. 

[0068] Fig. 8 shows an embodiment of an image sensing device in a second aspect of the Invention. In this embod- 
iment of Fig. 8 using progressive CCDs, the output signals of taking moving picture in Fig. 7 are once stored in a 
memory 901 , and progressive signals and interlacing signals are selected and issued from this memory 901 . 
55 [0069] In Fig. 8. as the structure and operation from the CCDs 111 , 112. and 113 to sampling frequency converter 6 
are same as in the embodiment in Fig. 7. so the explanation is omitted. 

[0070] A memory 901 stores progressive moving video output from the sampf Ing frequency converter 6. The memory 
901 may issue the stored signals sequentially in every line as progressive signals, or may issue in every other line as 
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interfacing signals. In the case of output of high-definition still picture, it is same as in the case of Fig. 7, and the 
explanation is omitted. 

[0071] As explained herein, in this embodiment, the CCD for G is arranged in a shifted disposition from the CCDs 
for R and B in the norizontal and vertical directions, and ft also generates two lines of Y signals having a double number 
s of pixels of R, G, B in the horizontal direction, and corresponding to the position shifted by 1/2 pixel in the vertical 
direction, by parallel processing. The image sensing device issues two sets of luminance signals Y1 and Y2 by storing 
in the memory in still picture processing, and issues only one set of luminance signal Y1 in moving picture taking by 
converting the sampling frequency. 

Theref ore, in addition to the benefits of the foregoing embodiments, this image sensing device has the following merits: 

to in this image sensing device, the majority of circuits for moving picture processing and still picture processing can be 
commonly used; and the Image sensing device is capable of performing moving picture processing and high-deflnltlon 
still picture processing simultaneously, so that a high-definition still picture can be taken simultaneously while taking 
a moving picture. In the eaplanation of these two embodiments, for the convenience of explanation, the pixels of CCD 
for G are shifted by 1/2 pixel In the horizontal direction and vertical direction, from pixels of CCDs for R and B. Actually, 

is however, due to effects of chromatic aberration of the optical system or the like, the physical spatial position of 1/2 
pixel on the CCD photo detecting surface and the optical spatial position of 1/2 pixel do not always coincide with each 
other. Therefore, the pixels of CCD for G should be shifted from pixels of CCDs for R and B in the horizontaJ direction 
and vertical direction, preferably by optical 1/2 pixel, instead of physical 1/2 pixel. In other words, three image sensing 
elements R,G, and B are arranged in an obliquely shifted disposition so that the Image sensing element for G may be 

20 shifted from the image sensing elements for R and B by Ph/2+a and Pv/2*b, respectively, in the horizontal and vertical 
direction where Ph and Pv are pixel arrangement intervals of the image sensing elements in the horizontal and verticaJ 
direction respectively, a and b are positive constants satisfying the relation of 0 < a < Ph/2 and 0 < b < Pv/2. 
[00721 ^g- 9 ' s a block diagram of a different embodiment of Image sensing device. CCDs 101,1 02, and 1 03 ,are 
interlacing CCDs for R f G, and B, respectively. In Fig. 9, as the structure and operation from the block of CCDs 101 , 

2s 1 02, and 1 03 to the block of selector 7 are same as those of the CCDs 1 01 , 1 02, and 1 03 to that of selector 7 in Fig. 
1 , so the explanation Is omitted. 

(0073] Whether the image sensing device is in taking still picture mode or in taking moving picture mode, a video 
recording unit 30 records video signals from the selector 7 in an internal recording medium. Whetherthey are recorded 
in the video recording unit 30 or not, a display unit 31 displays the video signals from the selector 7 or the video recording 
30 unit 30. 

[0074] The video recording unit 30 and display unit 31 can be also applied in the foregoing embodiments in Fig. i , 
Fig. 7, and Fig. 8, or In an embodiment in Fig. 10. 

[0075] In addition to the above effects, the image sensing device of the embodiment has such advantages: that the 
image sensing device continues to record or display the picture always while taking a picture; and that, therefore, If 
& shifting from taking moving picture mode to taking still picture mode, the image sensing device can record and display 
the picture without interruption. 

[0076] In the nnage sensing devices in Fig. 1 and Fig. 9, using three interfacing CCDs, pixels of three CCDs are 
shifted to oblique the direction. In these image sensing devices, a spurious color may be generated in the C signal in 
taking moving picture. For instance, In these image sensing devices, spatial positions of R signal and B signal of output 
40 of matrix processing for chrominance signal are shifted from the G signal by 1/4 pixel in the vertical direction. Accord- 
ingly, for example, in these image sensing devices, when taking a piciure having a sharp vertical edge In achromatic 
color, i.e in black and white, a spurious color is generated in the vertical edge portion. 

[0077] An embodiment in Fig. 1 0 solves this problem, by shifting the position of the pixels properly by using three-CCD 
interlacing system. This image sensing device is capable of issuing pictures of high quality picture without obvious 
4S spurious color both in taking moving picture mode and taking still picture mode. The image sensing device in Fig. 10 
interpolates the C signal, and changes the spatial positions of interpolation output signals in taking moving picture 
mode and taking still picture mode, by a specific interval- 

[0078] Fig, 10 is intended to eliminate occurrence of spurious color, and is basically same as a block diagram of 
image sensing device in other embodiments of the invention. 
so [0079] Fig. 1 o is similar to Fig. 1 and Fig. 9 in its basic structure and configuration of respective units. Three Interlacing 
CCDs 101, 102, and 103 are image sensing means for R, G, and B, respectively, and they are same as the image 
sensing means which are CCDs shown in Fig. 1 and Fig. 9. An analog processing unit 2, A/0 converters 301, 302, 
and 303, first memory means 8, a horizontal zoom circuit 501 , a sampling frequency converter 6, second memory 
means 9, and an interlace corrector 10 are same as those shown in Fig. 1 and Fig, 9 In configuration and function 
thereof. Explanation of these units are omitted herein. 

[0060] The matrix circuit 401 in Fig. 1 and Fig. 9 is corresponds to a block comprising a mode setting circuit 411, a 
selector 414, an Interpolation calculation circuit 416, Y signal matrix circuit 415, and C signal matrix circuit 417 in the 
embodiment in Hg. 1 0. These units are explained. A/D converter301 to 303 convert the outputf rom the analog process- 
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ing unit 2 into digital signals. First memory 8 stores the outputs of the A/D converters 301 to 303. Selector 41 4 selects 
one of the outputs from the A/D converters 301 . 302, and 303, and output from the first memory means 8, and issues 
selected one to a later stage. The Y signal matrix circuit 415 processes the R, G, and B signals of output from the 
selector 414, and generates two sets of luminance signals Y1 and Y2. The interpolation calculation circuit 416 inter- 

s polates the R, G, and B signals of output from the selector 414 in horizontal and vertical directions, so as to generate 
R, G, and B signals for pixels at interpolation positions. The C signal matrix circuit 417 processes the R, G, and B 
signals of output from the interpolation calculation circuit 41 6, so as to generate one set of chrominance signal C, The 
mode setting circuit 41 1 judges whether the Image sensing device is presently taking still picture or moving picture, so 
as to issues a mode setting signal. Consequently, the selector 7 selects either of the moving picture signal or still picture 

to signal based on this mode setting signal, and generates the luminance signal Y and chrominance signal C of the 
selected image. 

[0081] Rg. 11 is a block diagram showing a specific structural example of the interpolation calculation circuit 41S 
shown in Fig. 10. In the diagram, 1H (one horizontal scanning) lino memories 211, 212, and 213 delay R, G, and B 
signals issued from the selector 41 4 by on© horizontal scanning period (1 H) each respectively. Another 1 H line memory 

15 214 delays the G signal output from the 1 H fine memory 21 3 further by 1 H period. 

1008?] An interpolation coefficient generatorfiS generates interpolation coefficients k1 and k2 depending on the mode 
setting signal from the mode setting circuit 41 1 , and it sends the coefficient k1 to multipliers 221 and 222, and it sends 
coefficient k2 to muftipl iers 223 and 224. The multipliers 221 and 222 multiply the R signal and B signal from the selector 
414 by the coefficient k1 generated by the interpolation coefficient generator 28, respectively. The multipliers 223 and 
224 multiply the signals issued from the 1 H line memories 211 and 212 by the coefficient k2 generated by the interpo- 
lation coefficient generator 28, respectively An adder 231 adds the output of the multiplier 221 to the output of the 
multiplier 223 r and an adder 232 adds the output of the multiplier 222 to the output of the multiplier 224. 1T(one clock) 
delay lines (1 TDLs) 241 and 242 delay the outputs of the adders 231 and 232 by one clock (IT) period each. An adder 
233 adds the output of the adder 231 tD the output of 1T delay line 241 , and an adder 234 adds the output of the adder 

25 232to the 1T delay line 242. Bit shifters 251 and 252 shift the outputs of the adders 233 and 234 by 1 blteach, in other 
words, amplify them by 1/2 times, and issue R signal and B signal. 

{0083] A multiplier 261 multiplies the output of the 1 H line memory 213 by coefficient "6". An adder 271 adds up the 
G signal input from the selector 414, the output of the multiplier 261 , and the output of the 1 H fine memory 214. The 
1TDL 243 delays the output from the adder 271 by 1T. Other 1TDL 244 delays the output from the 1TDL 243 further 
3Q by 1T. A multiplier 262 multiplies the output of the 1TDL 243 by coefficient "5°. An adder 272 adds up the output of the 
adder 271 , the output of the multiplier 262, and the output of the 1TDL 244. A bit shifter 29 shifts the output of the 
adder 272 by 6 bits, in other words, multiplies Its amplitude by 1/64 times. 

[0084] First, the operation of the image sensing device in taking still picture is explained. As spatial positions of R, 
G, and B signals of the interlacing CCDe 1 01 , 1 02, and 1 03 are same as in Fig. 5, and hence detailed descnption is 
35 omitted herein. The first memory 8 stores R, G, and B signals of all pixels of The CCDs 1 01 , 1 02, and 103. In this case 
of taking still picture, the mode setting circuit 41 1 generates a mode setting signal fortaking still picture, and the selector 
414 selects the output from the first memory 8. As a result the selector 414 issues R. G, and B signals for reproducing 
the spatial positions on the CCD as shown in Fig. s. 

[0085] AY matrix circuit 415 receives R, G, and B pixel signals from the first memory means 8 at sampling frequency 
4> fs, and calculates luminance signals Y^.Y^. ...of each pixel, according to formula 5, from signals R^, Rgg, ...of red 
pixel R, signals , G^, ... of green pixel G, and signals Bsv B22. — of blue pixel B, and issues the calculated results 
as Y1 signal at sampling frequency 2fs. 

[O086) Similarly, the Y matrix circuit 41 5 receives R, G r and B pixel signals from the first memory means 8 at sampling 
frequency fs, and calculates luminance signals Y2 11v Y2 12 . ... of each pixel, according to formula 6, from signals R fl1 , 
4* R&> ... of red pixel R, signals G l1( G 12 , ... of green pixel G, and signals B^, B^, ... of blue pixel B, and issues the 
calculated results as Y2 signal at sampling frequency 2fs. 

[0087] On the other hand, the interpolation calculation circuit 416 interpolates based on the interpolation coefficients 
k1 =1/2 and k2= 1/2 from the interpolation coefficient generator 28 since it is the taking still picture mode at the present 

Herein, the interpolation calculation circuit 41 6 interpolates R signaJ and B signal as indicated by R^' and B^' in 

so formula 6. The spatial positions of R signal and B signal after Interpolation calculation are shifted by the portion of 1/2 
pixel in the horizontal direction and in vertical direction as compared with the spatial positions before interpolation 
calculation, supposing the pixel interval of R signal and Bslgnal of the input of the interpolation calculation circuit 416 
tobel. 

ss 

[formula 8] 
r 21 , =(R2t 4 -R 31 +R 22 +R^)/4 



10 
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[0088] In this taking still picture mods, the R and Bsignals and G signal from the interpolation calculation circuit 41 6 

5 are shifted from the R, G, and B output signals from the selector 414, by half pixel in the horizontal and in vertical 
directions, and therefore by this calculation, the spatial positions of R and S signals from the interpolation calculation 
circuit 41 6 are matched with the positions of G signal both in horizontal and in vertical directions. Further, the G signal 
is processed by low pass filtering operation as shown in formula 9. 

10 

[formula 9] 
, =(Gm i 1 +6G m^i +6m 31 )/B 

is where 

Gm 11 =(G l0 +6G 1l +G 12 )/B 
<3m ai =(G2a+6G2i+G2^/8 

Gm 31 =(G 30 +eG 31 4-G 32 )/8 

[0089] H 9 12 shows a vertical frequency characteristic of R signal and B signal of the output of the interpolation 
£0 calculation circuit 41 6, and Fig. 13 shows a vertical frequency characteristic of G eig nal of the output of the interpolation 

calculation circuit 41 6. Fig. 14 shows a frequency characteristic of R, G, and B signals of output from the selector 41 4. 

Thus, by interpolation calculation, in other words, low pass filter (LPF> operation, it is known that the characteristics of 

vertical frequency component are matched very well among the R signal, B signal, and G signal with each other. 

[0O9O] This is the same in the horizontal direction, and the explanation in the horizontal direction is omitted. 
25 [0091] As a result, the c matrix circuit 417 produces C signal from red signals R^', 9 rceri sI 9 naJs 

Ggg, .. M and blue signals B^ 1 , B^*, ... issued from the interpolation calculation circuit 41 6. This C signal is suppressed, 

therefore, in generation of spurious color. 

[0092] The Y and C signals thus produced in the Y signal matrix circuit S and C signal matrix circuit 7 are put into 
the horizontal zoom circuit 501. which converts theY and C signals Into signals having square pixels. 
30 [00931 The Y signal outputs from the second memory 9 are issued alternately starting from the Y2 signal positioned 
higher In the space, in the sequence of Y2 signal, Y1 signal, Y2 signal, Y1 signal, and Y2 signal successively As 
3 result, the Y signal is put into a selector 71 as luminance signal having vertical 960 pixels. 
[0094] On the other hand, the interlace corrector 1 0 receives C signal output of vertical 480 pixels from the second 
memory 9, 

35 [0095] The interlace corrector 1 0 interpolates the C signal of vertical 480 pixels in the vertical direction, and issues 
C signal of vertical 960 pixels to the selector 71 . 

[0098] The taking moving picture mode is explained below. For the sake of sfmplicity, herein, it is explained that the 
adjacent vertical pixels in a CCD are not driven simultaneously and the output signals from adjacent vertical pixels are 
not added up to each other. 

40 [0097] When taking a moving picture, the (mage sensing device must issue moving picture signals during one field 
period. First, the CCDs 1 01 , 102, and 103, analog processing circuit 2, and A/D converters 301 , 302. and 303 operate 
same as in the case of taking still picture mode explained above. The selector 41 4 receives a mode setting signal from 
the mode setting circuit 411 , and selects the output signal from the A/D converters 301 , 302, and 303, and issues them 
to a later stage, where It fs the taking moving picture mode at the present The Y signal matrix circuit 41 7 calculates 

6 the matrix of formula 1 in odd fields, and calculates the matrix of formula 5 in even fields, so as to determine the 
amplitude of pixel signals of Y1 signal . The sampling frequency converter 6 issues this Y1 signal at sampling frequency 
2fs. As a resuft, the sampling frequency converter 6 obtains the Y1 signal corresponding to G signal having a double 
number of pixels in the horizontal direction. That is. when R, G, and S pixel signals correspond to horizontal 766 pixels, 
the Y1 signal Is a sfgnal of high picture quality corresponding to horizontal 1 536 pixels. 

so [oog9] On the one hand, in the interpolation calculation circuit 41 6. the interpolation coefficient generator 2B (shown 
in Fig. 11) receives a mode setting signal from the mode setting circuit 411, and generates interpolation coefficients 
kl = 1/4 and k2 = 3/4, in the case that it is the taking moving picture mode at the present In this case, therefore, 
different from the case of taking still picture, the interpolation calculation circuit 416 calculates the signal, B3/ 
signal, and G 3l " sfgnal according to formula 1 0 in odd fields, and the interpolation calculation circuit 416 calculates the 

55 R 21 " signal, B^" signal, and Gfe,* signal according to formula 1 1 in evert fields. As a result, the spatial positions of R 
signal and B signal after interpolation calculation are shifted by 1/4 pixel space in the vertical direction, and by 1/2 pixel 
spaces in the horizontal direction compared with the spatial positions before interpolation calculation, supposing the 
pixel interval of R sfgnal and B signal before the interpolation calculation to be 1 , same as in the case of taking still 
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picture. 

[formula 10J 

B3 1 n =(3B3 1 +B 51 +3B 32 +B 52 y8 
G 31 "=(Gm 11 +6Gma 1 +em 51 )i , B 

10 

where 

Gm 11 =(G 10 +6G l1 +G 12 V8 
Gmg 1 =(G 3 o+6G 31 +G32)/8 
is Gm 51 =(G 50 +6G Sl +G 5 2)/8 

[formula 11] 

^ R 21 ,, bi(3R 21 +R4 1 +3R 2 2+R 4 2)/8 

B 21 M3B 21 +B 41 +3B 22 +B 4£ V8 
G 81 °=(Gm 0l -f^Gm^ +Gm 41 )/B 

where 

Grr\n=(Goo+«Goi+6D2y8 
Gm 21 =(G2 0 +eG 2l +G22)/6 
Gm 41 =(G 40 +6G 61 +G 42 )/8 

so [0099] Fig, 15 shows a spatial configuration of pixels of CCDs when taking a moving picture and generated Y signal 
and C signal. In this drawing, c signals are indicated as Cr{=R-Y) and Cb(=B-Y) which are color difference signals. 
These color dffferenco signals are similar to the chrominance signal C, which has been explained in the aforesaid 
drawings and explanations 

[01 00] In this taking moving picture mode, R, G, and B output signals from the selector 41 4 are, for example In odd 

as fields, respectively red signals ft^, R^, green signals G 1V .... and blue signals B 11# B 31 being shifted by 

1/£ pixel In the horizontal direction and by 1/4 pixel in the vertical direction. These R signals, B signals, and G signals 
shifted in spatial positions are matched with the spatial positions after interpolation calculation. 
[0101] Fig. 16 shows a vertical frequency characteristic of R signal and B signal of the output from the interpolation 
calculation circuit 41 6. The interpolation calculation circuit 41 6 calculates the G signal by LP F operation according to 
40 formula 9 same as in the case of taking still picture, so as to obtain a frequency characteristic as shown In Fig. 13. As 
a result, the R signal, B signal, and G signal of the output of the interpolation calculation circuit 41 6 are almost matched 
also in the vertical frequency characteristic with the R signal, B signal, and G signal of the output of the selector 41 4. 
The horizontal frequency characteristic Is the same as in the case of taking still picture. 

[0102] The C signal matrix circuit 41 7obtalns red chrominance signal Cr and blue chrominance signal Cb by matrix 
4$ calculation according to formula 12 in odd fields, and obtains red chrominance signal Cr and blue chrominance signal 
Cb by matrix calculation according to formu la 1 3 in even fields, from R, G and B signals matched in the spatial position 
and frequency component both in horizontal direction and in vertical direction. In this moving picture taking mode, too, 
the C signal matrix circuit 417 obtains C signal suppressed in generation of spurious color same as in the case of 
taking still picture mode. Meanwhile, since the O signal is same as G signal in the number of pixels, then supposing 
50 the number of pixels of CCD to be horizontal 768 pixels, the number of pixels of C signal is horizontal 768 pixels, 

[formula 12] 
Cr 31 =O.70rV-O.S$<V-0.t 1 B S1 " 
Cb 31 =-O.30H 31 "-0.59G 31 *+0.89B 31 " 
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[Tormufa 13] 
Cr 21 =0,70R 2l "-0.596^ "-0J 1 • 
5 Cb 21 ^-0.30R 21 H -0.596 21 VO^B^ 9 

[0103] the selector 71 receives a mode setting signal from the mode setting circuit 411, and selects the output of 
the sampling frequency converter 6, in the case that it is the taking moving picture mode at the present. The image 
to sensing device Issues a moving picture signal from th© selector 71 . As a result, the image sensing device obtains 
interlacing moving picture signals In horizontal 720 pixels and in vertical 460 pixels, having little spurious color same 
as in taking still picture mode. 

[0104] As explained herein, the embodiment in Fig. 1 0 brings about the following merits: R signal, B signal, and G 
signal used in generation of C signal are matched in the spatial position and in frequency component both for taking 
is moving picture and for taking still picture, and therefore the image sensing device of th© embodiment can produce 
images little in spurious colors both in moving picture and in still picture of high resolution; and as the image sensing 
device of the embodiment changes over the high resolution still picture and moving picture only by changing the zoom 
factor of the selector and horizontal zoom circuit, so it does not require vertical zoom circuit for converting the resolution 
in vertical direction. 

sq [0105} Fig. 1 7 shows other embodiment of the interpolation calculation circuit 41 6. Although the interpolation calcu- 
lation circuit 41 6 of fig. 11 comprises six multipliers 221 , 222, 223, 224, 261 , and 271 , but those multipliers 221 , 222, 
223, and 224 of Fig. 11 are replaced by the adders 711 . 712, 713. and 714, bit shifters 721. 722. 723, 724, 725, and 
726, and selectors 731 and 732 as shown in Fig. 1 7. Thus, the mode setting signal from the mode setting circuit 411 
may change over the outputs of the selectors 731 and 732, Alternatively, in the interpolation calculation circuit 41 6, 

25 the multipliers 251 and 262 in Pg. 11 maybe replaced by bit shifters 741 and 742, and, 743 and 744, and adders 751 
and 752. The configuration shown In Fig. 17 can be curtailed in the circuit scale, because the digital multiplication Is 
executed by bit shifters and adders. 

[Q1QS] In the interpolation calculation circuit 416 of the embodiment, the Interpolation calculation and LPF operation 
for R signal, G signal, and B signal can be carried out by using formula 8 and formula 9 in taking still picture, and by 

30 using formula 10 and formula 11 in taking moving picture. The formulas are not, however, limited to these, but any 
other formulas may be used as far as the spatial position and frequency characteristics In the horizontal and in vertical 
directions after calculation are matched the R signal, B signal, and G signal with each other. 
[01 07] tn the illustrated embedments, the adjacent vertical pixels of interlacing CCDs are not driven simultaneously 
in taking moving picture mode, but the same effects are obtained in the case of driving the adjacent vertical pixels 

35 simultaneously, such as pixels G 11 arid G 21 , and G 41 , ... in odd fields, or G S1 and G^, G 41 and G 51 , ... In even fields. 
[0108] tn the embodiment, the first memory B and second memory 9 are seperated. but same effects are obtained 
when the two memories are realized by one memory having two different regions therein. 

[0109] In the explanation of the embodiment, for the convenience of explanation, the pixels of CCD for G are shifted 
by 1/2 pixel tn the horizontal and vertical directions, from pixels of CCDs for R and S. Actually, however, due to effects 
of chromatic aberration of the optical system or the like, the physical spatial position of 1/2 pixel on the CCD photo 
detecting surface and the optical spatial position of 1/2 pixel do not always coincide with each other. Therefore, the 
pixels of CCD for G should be shifted from pixels of CCDs for ft and B in the horizontal direction and vertical direction, 
preferably by optical 1/2 pixel, instead of physical 1/2 pixel. 

[01 10] Thus, according to the embodiment in Fig, 1 0, spatial positions of R and B signals of the output of the Inter- 
ns polation calculation circuit corresponding to the R and B signals of the input of the interpolation calculation circuit are 
shifted by a specific interval in the moving picture taking and still picture taking. Therefore, the image sensing device 
of the embodiment has the following merits: in moving picture taking and still picture taking, th© G signal is matched 
in space and frequency with the R signal and 5 signal used in creation of C signal; and as a result, the image sensing 
device of the embodiment can produce a picture of high quality and small in spurious color in both moving picture and 
so high-resolution still picture. 

[0111] The image sensing device of the invention has the following advantages: the angle of view is not changed 
between the moving picture taking and still picture taking modes; the CCD driving frequency is equalized between the 
still picture taking and moving picture taking modes; the driving frequency is not so high, and the power consumption 
is suppressed; in the three-CCD system of the invention, the number of pixels of CCD necessary for still picture is 1/4 
s& that of the single-CCD type; as a result, In the optical system of a same size, the pixel area can be increased up to 4 
times that of the single-CCD system, and it is advantageous in the aspect of the sensitivity, that Is, the S/M ratio; and 
to the contrary, when the sensitivity is the same, the size of the optical system can be reduced, so that the camera or 
device is reduced in size. 
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[0112] In the embodiment, the CCD for G is deviated from the CCDs for R and B in the horizontal and vertical 
directions, and two lines of Y signals having a double number of pixels of R, G, B in the horizontal direction and 
positioned at 1/2 pixel deviation in the vertical direction are created by parallel processing. The Image sensing device 
issues two luminance signals Y1 and Y2 by storing in the memory In still picture taking, and issues only one luminance 

5 signal Y1 in moving picture taking by converting the sampling frequency. 

[0113] Therefore, in addition to the benefits of the foregoing embodiments, this image sensing device has the fol- 
lowing merits: in this image sensing device, the majority of circuits for moving picture processing and high-definition 
still picture processing can be commonly used; and the image sensing device is capable of performing moving picture 
processing and high-definition still picture processing simultaneously, so that a high-definition still picture can betaken 

10 simultaneously while taking a moving picture. 

fl)114] Further, according to other embodiments, the image sensing device shifts the spatial positions of R and B 
signals of the output of the interpolation calculation circuit to the R and B signals of the input of the interpolation 
calculation circuit by a specific interval between the moving picture taking and still picture taking. 
[0115] Therefore, the image sensing device of the embodiment brings about the following merits: in moving picture 

fs taking and still picture taking, the G signal is matched in space and frequency with the R signal and B signal used in 
creation of C signal; and as a result, the image sensing device of the embodiment can produce a picture of high quality 
and small in spurious color in both moving picture and high-resolution still picture. 



£0 Claims 

1 . An image sensing device comprising: 

a) image sensing means (1) having individual image sensing elements (101, 102. 103, 111, 112, 113) for red 
29 (R), green (G), and blue (B), in which three image sensing elements are arranged in an obliquely shifted 

. disposition so that the image sensing element for G (1 02, 1 1 2) are shifted from the image sensing elements 
for R (101, 111) and B (103, 113) by Ph/2+a and Pv/2+b ( respectively, in the horizontal and vertical drection 
where Ph and Pv are pixel arrangement intervals of the image sensing elements in the horizontal and vertical 
direction respectively, a and b are constants satisfying the relation of 0 <=s a < Ph/2 and 0 <= b < Pv/2; 

so 

b) luminance signal generating means (15, 16), which processes the output signal of the image sensing means 
in such way 

0 that said luminance signal generating means (15) generating a first luminance signal (Y1) of which 
as number of pixels in the horizontal direction Is approximately 2 times that of the image sensing element for 

green by using pixel signals of the image sensing elements for red (1 01 , 1 1 1 ) R miR and for blue (1 OS, 113) 
B m n and the signal from the pixel of the image sensing element for green (102,' 112) G m n positioned at 
the closest lower right position and the signal from the pixel of the image sensing element for green (1 02, 
112) G m nBl positioned at the closest lower left position in space to the image sensing elements for R min 
-«> and n according to the formula: 

Y1 m ^ n = 0.30 R^ f 0.59 G m , n + 0.11 B mn 

45 Y1 mt2n = 0.30 + 0.59 G m n + 0.11 

and 

40 \\) that said luminance signal generating means (1 6) generating a second luminance signal (Y2) of which 

number of pixels in the horizontal direction is approximately 2 times that of the image sensing element for 
G by using pixel signals of the image sensing elements for red (1 01 , 111) n and for blue (1 03, 113) 
B rajl and the signal from the pixel of the image sensing element for green (102, 112) G^ ft positioned at 
the closest upper right position and the signal from the pixel of the image sensing element for green (1 02, 

& 112) G m .| tI>1 positioned at the closest lower left position in space to the image sensing elements for R m ^ 

and according to th© formula: 
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5 - °- 3 ° *Wi + 0.59 + 0.11 B m ^ 

c) sampling frequency converting means (6). which reduces at least one sampling frequency in the horizontal 
direction and vertical direction of the first luminance signal (Y1) at a specified ratio, and generates as a third 
luminance signal,- and 

10 

d) second memory means (9). which stores the first luminance signal (Y1) and second luminance signal (Y2), 
and issues the first luminance signal (Y1) and second luminance signal (Y2) alternately in every line;. 

wherein the output signal of said sampling frequency converting means (6) is a moving picture Image sensing 
output, and the output of said second memory (9) means is a still picture image sensing output. 

The image sensing device of claim 1, wherein said image sensing means comprises first memory means (8) for 
storing output signals for all pixels of the image sensing elements for R, G and B, and output signals from the 
image sensing elements for R (101 ,111), G (10£, 112) and B (1 03, 113) are used as moving picture signal when 
taking a moving picture, whereas output signals for alt pixels stored in the first memory means (S) are used as still 
picture signal when taking a still picture. 

TT>e image sensing device of claim 1 or 2, further comprising: 

selecting means (7) for selecting and issuing one of the output signal of the sampling frequency converting 
means (6) and the output signal of the second memory means (9), wherein said selecting means (7) selects 
the output signal of the sampling; 

frequency converting means (6) as moving picture signal when taking a moving picture, and the selecting 
means (7) selects the output signal of the second memory means (9) when taking a still picture. 

The image sensing device of claim 1 , said second memory means (901) further comprising a first output port and 
a second output port, which stores the first luminance signal (Y1)> second luminance signal (Y2), and said third 
luminance signal (Y1), 
wherein said second memory means (901 ) 

i) issues the third luminance signal (Y1)from the first output port, sequentially in one of every line and every 
other line, and 

40 ii) issues the first luminance signal (Y1) and second luminance signal (Y2) from the second output port alter- 

nately in every line. 

5. The image sensing device of any of claims 1 to 3, further comprising: 

45 selecting means (7) for selecting and Issuing one of the output signal of the sampling frequency converting 

means (6) and the output signal of the second memory means (9), wherein 

r) said selecting means (7) selects and issues the output signals of the image sensing elements for R, G 
and b , through the luminance signal generating means (15, 1 6) and samplingf requency converting means 
50 (6), when taking a moving picture, 

ii) in a transition period from taking moving picture to taking still picture, the selecting means (7) selects 
and Issues the signal of the second memory means (9) through the luminance signal generating means 
(15, 16) and sampling frequency converting means (6), and 

55 

Hi) the selecting means (7) selects and issues the output signal of the second memory means (9) when 
taking a still picture. 



15 



20 



25 



30 



4. 
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6. The image sensing device of claim 5, further comprising? 

recording means (30) for recording the output signal of the selecting means (7) in a recording medium, and 

5 display means (31) for displaying the output signal from the recording means (30), 

wherein the image sensing device displays the video signal in the display means (31) while recording in the re- 
cording medium of the recording means (30) in taking moving picture and taking still picture, and in a transition 
period from taking moving picture to taking still picture, the image sensing device displays the video signal in the 
10 display means (31) without recording in the recording medium of the recording means (30). 

7. The image sensing device of any of claims 1 to 6, further comprising: 

interpolating means (41 6) for interpolating a signal selected by a selection means (41 4) in the vertical direction, 
is and obtaining an interpolation output signal corresponding to an arbitrary spatial position, and 

chrominance signal generating means (41 7) for generating a chrominance signal from the output signal of the 
interpolating means, 

20 wherein the Interpolating means (416) issues an interpolation output signal corresponding to a position different 
in a spatial position by a specific interval between taking moving picture and taking still picture. 

8. The image sensing device of daim 7, wherein said Interpolating means (41 6) issues an interpolation output signal 
corresponding to a position different in a spatial position by a 1/4 pixel pitch in the vertical direction between taking 

29 moving picture and taking still picture. 

9. The image sensing device of any of claims 1 to 8, wherein said image sensing elements (1 01 , 1 02, 1 03) are driven 
by interlace scanning. 

so 10. The image sensing device of any of daims 1 to 8, wherein said image sensing elements (11 1 , 1 1 2, 1 1 3) are driven 
by progressive scanning. 

11. The Image sensing device of any of claims 1 to 1 0, wherein the image sensing element for G (102, 112) Is shifted 
from the image sensing elements for R (ioi , 111) and B (103, 113) by Ph/2 and Pv/2, respectively; In the horizontal 
3? direction and vertical direction. 

Patentanspruche 

40 1 , BOderfassirngsvorrichtung, die umfassfc 

a) Bilderfassungseinrichtung (1), die einzelne Bilderfassungselemente (101 , 1 02, 103, 111 , 112, 113) fOr Rot 
(R), Grun (G) und Biau (B) aufweist, wobei drei Bilderfassungselemente schnig versetzt so angeordnet sind, 
dass die Bilderfassungselemente fOr G (102, 112) gegenflber den Bilderfassungselementen fQr R (101, 111) 

45 und B (103, 113) in der horlzcrrtalen und der vertikalen Richtung urn Ph/2+a bzw. Pv/2+ verschoben sind, 

wobei Ph und Pv Pixelanordnungsintervall© dor Bilderfassungselemente in der norizontalcn b2w. vertikalen 
Richtung sind und a sowie b Konstanten sind, die die Beziehung 0 5 a < Ph/2 sowie 0 s b < Pv/2 erfullen; 

b) eine Helligkeitssignal-Erzeugiingseinrichtung (15, 16), die das Ausgangssignal der Bllderfassungselnrich- 
50 tung so verarbeftet, dass: 

I) die HolligKertssignaJ-erzeugungseinricrrtung (15) em erstes Helligkeitssignal (Y1), bei dem ale Anfcahl 
von Pixeln in der horizorrtalen Richtung ungsfahr das Zweifache der des Bilderfassungselementss fur 
Grun betragt, unter Verwendung von Pixelsignalen der Bilderfassungselemente fur Rot (101 , 111) R^ 
5ff und fur Blau (103, 113) B min und des Signals von dem Pixel des Bilderfassungselementes fur Grun (102, 

112) G m n , das an der am nahe Itegendsten unteren rechten Position angeordnet ist, und des Signals von 
dem Pixel des Bilderfassunselementesfur Grun (1 02, 112) G m n . if das an der am nahe liegendsten unteren 
Knken Position im Raum 2u den Bilderfassungselementen R^ri und 5 m,n angeordnet ist, gemaB der fol* 
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genden Gleichung erzeugt 

VI m = 0.30 R mtrt + 0.59 G mfn + 0.1 1 B^ 

5 

Y1 m 2n = 0.30 R ro , n+1 + 0.59 G ffl|ft + 011 

und 

10 

ll) dass die HelllgkeitssignaNer2eugungseinrichtung (16) ©in zweites Helligkeiteslgnal (Y2), bei dem die 
Anzahl von Pixdn in derhorizorrtalen Richtung ungefShrdas Zweifache der des Bilderfassungselementes 
fur G betragt, unter Verwendung von Pixeisignalen der Bilderfassungselernente fur Rot (101, 111) R ran 
und fur Blau (103, 1 13) B^ und des Signals von dam Pixel des Bilderfassungselem antes fur Gain (102, 
is 112) G m _ 1ifl , das an der am nahe liegendsten oberen recrrten Position ahgeordnet ist, und des Signals 

von dem Pixel des Bllderfassungseiementesfur GrQn (102, 112) G m .f l r>i»das an der am nahe liegendsten 
unteren Irnken Position im Raum zu den Bitderfaeeungselementen fOr R mn und B^ angeordnet 1st. ge- 
maB derfolgenden Gleichung erzeugt: 

20 Y*m.1*H " R m,n + 0£9 G m-1.n + 0.1 1 B m , n 



+ O-S9G^ l(n + 0.11B m|ft+i 

2S 

c) eine Abtastfrequenz-Umwandlungseinrichtung (6), die wenigstens eine Abtastfrequenz in der horizontalen 
Richtung und der vertikalen RIchtung des ersten Helligkeitssignals (Y1) in elnem vorgegebenen Verhartnis 
verringert und ate eln drfttes Helligkeitssignal erzeugt; und 

90 d) eine zweite Speichereinnchtung (9), die das erste Helligkeitssignal (Y1) und das zweite Helligkeitssignal 

(Y2) speichert und das erste Helligkeitssignal CY1) sowle das zweite Helligkeitssignal (Y2) abwechselnd in 
jeder Zerte ausgibt; 

wobei das Ausgangssignal der Abtastfrequenz-Umwandlungselnrlchtung (6) eine Bewegtbild-Bilderfassungsaus- 
as gabe ist und die Ausgabe der zweiten Speichereinnchtung (9) eine Standbild-Bilderfassungsausgabe ist. 

2 t Bilderfassungavorrichtung nach Anapruch 1 , wobei die BUderfassungsein richtung eine erste Speichereinnchtung 
(8) umfasst, die Ausgangssignale fur alle Pixel der Bilderfassungeelemente fur R, G und B speichert, und Aus- 
gangssignals von den Bilderfassungselementen flj'r R (101, 111), G (102, 112) und B (1 03, 1 1 3) als Bewegtbildsw 
40 gnal verwendet werden, wenn ein bewegtes BOd aufgenommen wlrd, wahrend Ausgangssignale fur alle in der 
ersten Speichereinnchtung (8) gespeicherten Pixel als Standbildsignal verwendet werden, wenn ein Standbild 
aufgenommen wird. 

3. Bilderfassungsvorrfchtung nach Anspruch 1 Oder 2, die dee Welteren umfasst: 

45 

eine Auswahleinrichtung (7), dia das Ausgangssignal der AbtestfrecuertZ-UrnwandlUngselnrtchtung (6) Oder 
das Ausgangssignal derzwelten Speicherelnrichtung (9) auswahlt und ausgibt, wobei die Auswahleinrichtung 
(7) das Ausgangssignal der Abtastfrequenz-Umwandlungseinrichtung (6) als Bawegtbiid-Signal auswahrt, 
wenn eln bewegtes Bild aufgenommen wind, und die Auswahleinrichtung (7) das Ausgangssignal der zweiten 
so Speichereinnchtung (9) auswfihlt, wenn ein Standbild aufgenommen wind, 

4. Bilderfassungsvorrichtung nach Anspruch 1 , wobei die zweite Speicherein richtung (901 ) des Welteren einen ersten 
Ausgangsanschluss und einen zweiten Ausgangsanschluss umfasst, der das erste Helligkeitssignal (Y1), das 
zweite Helligkeitssignal (Y2) und das dritte Helligkeitssignal (Y1) speichert, 

ss wobei die zweite Speichereinrichtung (901) 

I) das dritte Helligkeitssignal (Y1) fiber den ersten Ausgangsanschluss sequen2iell in jeder Zeile Oder jeder 
zweiten Zeile ausgibt, und 



PAGE 96/127 ' RCVD AT 2/28/2007 4:00:28 PM [Eastern Standard Time] ' SVR:USPT0-EFXRF-1/19 ' DNIS:2738300 " CSED : 16508575487 ' DURATION (mm-ss):33-00 



FEB. 28. 2007 1:24PM HP LEGAL IP NO. Ill P. 97 

EP 1 173 029 B1 

J I) das erste HeHigketissignal (Y1 ) und das zweite Helfigkeitssignal (Y2) uberden zweiten Ausgangsanechluss 
abwechselnd in jeder Zeile ausgibt. 

5. Bilderfassungsvorrichtung nach einem der AnsprQche 1-3, die des Weiteren umfasst: 

5 

eine Auswahlelnrichtung (7), die das Ausgangssignal dsr Abtastfrequenz-Umwandlungseinrichtung (6) Oder 
das Ausgangssignal der zweiten Speichereinrichtung (9) auswahtt und ausgibt, wobei 

I) die Ausw&hleinrichtung (7) die Ausgangssignale der BilderfassungselementefOr R f G und B auswflhft 
to und Gber die Hellfgkeitssignal-Erzeugungseinrichtung (15, 1 6) sowie die Abtastfrequenz-Umwandlungs- 

ein richtung (6) ausgibt, wenn eln Bewegtbild aufgenommen wlrd, 

I I) in einem Ubergangs^eitraum vom Auf nehmen von Bewegtbild zum Aufnehmen von Standbild die Aus- 
t wahlGinrichtung (7) das Signal der zweiten Speichereinrichtung (9) auswShrt und Qber die Helligteitssl- 

15 gnal-Erzeugungseinrichtung (1 5, 1 6) sowie die Abtastfrequenz-Umwandlungseinrichtung (6) ausgibt, und 

III) die Auswahleinrichtung (7) das Ausgangssignal der zweiten Speichereinrichtung (9) auswfihlt und 
ausgibt, wenn ©in Standbild aufgenommen wird. 

so 6. Bilderfassungsvorrichtung nach Anspruch 5, die des Weiteren umfasst 

eine Aufzeichnungseinrictitung (30) 2um Aufeeichnen des Ausgangssignals der Auswahlelnrictrtung (7) auf 
einem Aufzeichnungsmedrum, und 

25 eine Anzelgeein richtung (31 ) zum Anzeigen des Ausgangssignals von dor Aufteich nungselnrlchtung (30), 

wobei die Bilderfassungsvorrichtung das Videosignal in der Anzeigeeinrichtung (31) anzeigt, wfihrend auf dem 
Aufzefchnungsmedium der Aufzeichnungseinrictitung (30) aufgezelchnet wird, wenn Bewegtbild aufgenommen 
wlrd und Standbild aufgenommen wird, und In einem Gbergangszeitraum vom Aufnehmen von Bewegtbild zum 
so Aufnehmen von Standbild die Bilderfassungsvorrichtung das Vidsosignal in der Anzeigeeinrichtung (31) anzeigt, 
ohne auf dem Aufzeichnungsmedium der Aiifzetehnungseinflchtung (30) aufzunehman. 

7. BiWerfassungsvorrichtung nach einem der AnsprQche 1 bis 6, die des Weiteren umfasst: 

SB eine IrrterpolierBinrichtung (416), die eEn dutch eine Auswahleinrichtung (414) ausgewahltes Signal In der 

vertikalen Richlung interpoliert und ein InlerpoJations-Ausgangsslgnal gewinnt, das einer beliebigen raurnii- 
chen Position ©ntspricht; und 

eine Farbsignal-Erzeugungseinrichtung (417), die aus dem Ausgangssignal der Irrterpoliereinrichtung ein 
40 Farbsignal erzeugt, 

wobei dls IntsrpDliereinrichtung (416) eln Interpolations-AusgangssignaJ ausgibt, das einer Position entspricht, die 
etch zwlschen Aufnahme von Bewegtbild und Aufnahme von Standbild bezOglich einer raumlichen Position um 
ein vorgegebenes Interval! unterscheidet 

45 

Q. BiWerfassungsvorrichtung nach Anspruch 7, wobei die Interpcfiereinrichtung (416) ein Interpolatiofis-Ausgangs- 
signal ausgibt, das einer Position entspricht, die etch zwischen Aufnahme von Bewegtbild und Aufnahme von 
Standbild um einen Abstand von 1/4 Pixel in der vertikalen Richtung unterscheidet 

so 9. Bilderfassungsvorrichtung nach einem der AnsprQche 1 bis 6, wobei die Bilderf assungselement© (1 01 , 1 02, 1 03) 
Im Zeilensprungverfahren (interlace scanning) angesteuertwerden. 

10. Bilderfassungsvorrichtung nach einem der Ansprflche 1 bis 8, wobei die Bilderf assungseiemente (111, 112, 113) 
im Zeflenfolgeverfahren (progressive scanning) angesteuertwerden. 

55 

11. Bilderfassungsvorrichtung nach einem der Arrspruche 1 bis 1 0, wobei das Bilderfassungselement fflr G (102, 112) 
gegenGber den Bilderfassungselementen fflr R (101, 111) und B (103, 113) in der horizontaten Richtung und der 
vertikalen Richtung um Ph/2 bzw. PW2 verschoben ist. 
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Revindications 

1 . Disposltlf de detecti on d'image comprenant : 

s a) un moyen de detection d'image (1) ayant des elements da detection d'image individuals (lot, 102, 103, 

111, 112, 113) pour fe rouge (R), le vert (V) el le bleu (B) dans lequef tes trois elements de detection d'image 
sont disposes dans une disposition decalee dans le sens oblique de sorte que I'eJemerrt de detection d'image 
pour v (1 02, 1 1 2) sont decales des elements de detection d'image pour ft (101, 111) et B (103, 113) de Ph/ 
2+a et Pv/2+b, respectivement, dans la direction horizontal© et verticale oQ Ph et Pv sont tee intervenes de 

10 disposition de pixels des elements de detection d'image dans la direction horizontal© et verticale respectrve- 

ment, a et b sont des constantes satisfaisant la relation d© O £ a < Ph/2 et 0 £ b < Pv/2 ; 



b) un moyen da generation de signal de luminance (i 5, 1 6), qui traite le signal de sortie du moyen de detection 
d'image d'une maniera telle 

15 

i) que ledlt moyen de generation de signal de luminance (15) generant un premier signal de luminance 
CV1 ) dont Id nombre de pixels dans ia direction horizontals est appraximativement 2f ofs celui de ^element 
de detection d'image pour le vert en utifisant les sign aux de pixel des elements de detection d'image pour 
te rouge (101, 111)8^ et pour le blej (103, 113)^^ et le signal provenant de pixel de ^element da 
so detection d'image pour le vert (1 02, 1 1 2)V m n positlonn'e a la position droite inferieure ta plus proche et le 

signal provenant du pixel de Tenement de detection d'image pour le vert (102, 1l2)V m ^ positionnS a la 
position gauche inferieure la plus proche dans Pespace aux elements de detection d'image pour ot 
B m ^ en oonformite avec [a forrnule : 

25 ^ m ^l -^OR^^0,59V mirr + 0.11B m(n 



et 



\\) que ledit moyen de generation de signal de luminance (1 6) genenant un signal de luminance (Y2) dont 
le nombre de pKels dans la directtpn horizontale est approximativement 2 f ois celul de relemerrt de de- 

35 tection d'image pour V en utiltsant (es signaux de pixel des elements de detection d'image pour le rouge 

(101, 111)R mpR et pour le bleu (103, 113)B ra(fI et le signal provenant de pixel de I'&ement de detection 
d'image pour'le vert (102, 11 2) V m . 1in position n6 a la position droite superieure la plus proche et le signal 
provenant de pixel de I'etement de detection d'image pour le vert (102, 112)7^^ posidonne k la position 
gauche inferieure ia plus proche dans I'espace vers les dements de detection d'image pour R m ^ et B mjn 

*o © n conformite avec la fomiule ; 



c) un moyen de conversion da frequence d'echantillonnage (6) qui reduit au moins une frequence d'echan- 
tiilonnage dans la direction horizontale et dans la direction verticals du premier signal de luminance (Y1) & un 

so rapport specifie, genere un troisieme signal de luminance ; et 

d) un second moyen de memoire (9), quf memorise le premier signal de luminance (Y1) et le second signal 
de luminance (Y2) et sort le premier signal de luminance (Y1 ) et le second signal de luminance (Y2) altema- 
tivement dans chaque ligne ; 

ss 

dans lequel le signal de sortie dudit moyen de conversion de frequence d'schantrllonnage (6) est une sortie 
de detection d'image animee, et la sortie de ladfte seconde memoire (9) est une sortie de detection d'image fixe. 
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2. Dispositif de detection damage selon la revendfcation 1 . dans lequel ledft moyen de detection d'image comprend 
un premier moyen de memoire (8) pour memoriser les signaux de sortie de tous les pixels des elements da de- 
tection d'image pour R, V et B, et les signaux da sortie provenant des Elements de detection d'image pour R (101, 
111), V (102. 112) et S (103, 113) sont utilises comrne signal d'image animee lore de la prise de vue cPuna image 

5 animee, tandis que les signaux de sortie pour tous les pixels memorises dans ie premier moyen de memoir© (8) 
sont utilises comma signal d'image fixe lors de la prise de vue d'une Image fixe. 

3. Dispositif de detection d'image salon la nevendication 1 ou 2, comprenant en outre ; 

w un moyen de selection (7) pour selectionner et delivner un du signal de sortie du moyen de conversion de 

frequence d'echantillonnage (6) et du signal de sortie du second moyen de memoirs (9), dans lequel ledit 
moyen de selection (7) selectionne le signal de sortie de I'echantillon ; 

un moyen de conversion de frequence (8) comme signal d'image animee lors de la prise de vu© d'une image 
is animee, et le moyen de selection (7) selectionne le signal de sortie du second moyen de memoire (9) lore de 

la prise de vue d'une image fixe. 

4. Dispositif de detection cf image selon la revendication 1, ledit second moyen de memoire (901) comprenant, en 
outre, un premier acces de sortie et un second acces de sortie, qui memorise le premier signal de luminance (Y1), 

20 le second signal de luminance (Y2) et ledit troisieme signal de luminance (Y1 ), 
dans lequel ledit second moyen de memoire (001) 

(i) deltvre le troisieme signal de luminance (Y1 ) depuis le premier acces de sortie, sequentiellement dans une 
de cheque ligne de chaque autre ligne, et 

25 

(ii) delh/re le premier signal de luminance (Y1) et le second signal de luminance (Y2) a partir du second acces 
de sortie altematlvement dans chaque ligne. 

5. Dispositif de detection d'image selon I'une quebonque des revendications 16 3, comprenant en outre : 

un moyen de selection (7) pour selectionner et sortir un du signal de sortie du moyen de conversion de fre- 
quence cfechantillonnage (8) et du signal de sortie du second moyen de memoire (9), dans lequel 

(i) ledit moyen de selection (7) selectionne et sort les signaux de sortie dee elements de detection d'image 

6 pour R, V et B, per I'intermedlalre du moyen de generation de signal de luminance (1 5, 1 6) et du moyen 
de conversion de frequence d'echantillonnage (6), lors de la prise de vue d'une image animee. 

(H) dans une pe/iode de transition de la prise de vue d'une image animee & la prise de vue d'une image 
fixe, Je moyen de selection (7) selectionne et delivre le signal du second moyen de memoire (9) par nn- 
40 termediaire du moyen de generation de signal d© luminance (15, 1 6) et du moyen de conversion de fre- 

quence cfechantllfonnage (6). et 

Oil) le moyen de selection (7) selectionne et delrvre le signal de sortie du second moyen de memoire (9) 
lors de ia prise de vue d'une image fixe. 

45 

Dispositif de detection d'image selon (a revendication 5, comprenant en outre : 

un moyen d'enregistrement (30) pour enregistrer le signal de sortie du moyen de selection (7) dans un support 
d'enregietrement, et 



30 



50 



un moyen d'affichage (31) pour afficher ie signal de sortie provenant du moyen d'enregistrement (30), 



dans lequel le dtepoeltfT de detection d'image afffche le signal video dans (e moyen cf affichage (31) tout en 
enregrstrant dans le support d'enregistrement du moyen d'enregistrement (30) dans la prise de vue d*une Image 
ss animee et dans la prise de vue d'une image fixe, et dans une period© d© transition de la prise de vue de I'image 
animee a le prise de vue de I'image fixe, Ie dispositif do detection d'image affiche le signal video dans Ie moyen 
cfaffichage (31) sans enregistrer dans le support cfenregistrement du moyen d'enregistrement (30). 



20 
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7. Disposftif de detection d'image selon funs quelconque dee revendications 1 a e, comprenant en outre : 

un moyen d'interpolation (41 6) pour interpoler un signal selectionne par un moyen de selection (414) dans la 
direction vertlcale et pour obtenir un signal de sortie ©^interpolation conespondant a une position spatiale 
5 arbitraire, et 

un moyen de generation de signal de chrominance (417) pour.generer un signal de chrominance a partir du 
signal de sortie du moyen d' interpolation, 

10 dans lequel le moyen ^interpolation (416) deiivre un signal de sortie ^interpolation correspondant a une 

position differente dans une position spatiale cTun intervalie specifique entre la prise de vue tfimage anlmee et la 
prise de vue d'image fixe. 

8. Dispositrf de detection d'image selon la revendlcation 7, dans lequel ledit moyen ^interpolation (416) deiivre un 
is signal de some d'interpolation correspondant a une position differente en position spatiale de !4 de pas de pixel 

dans la direction vertical© entre la prise de vue d'une image animee et la prise de vue d'une image f bee. 

9. Dispositrf de detection d'image selon rune quelconque des revendications 1 a 8, dans lequel lesdits elements de 
detection d'image (101 , 102, 103) sont attaques par un baiayage entrelace. 

20 

10. Dispositrf de detection d'image selon Tune quelconque des revendications 1 a 8, dans lequel lesdfts elements de 
detection cflmage (111 , 112, 113) sont attaques par un balayage pmgressrf. 

11. Dispositif de detection d'image selon rune quelconque des revendications 1 a 10, dans lequel ('element de detso 
25 tion cfimage pour V (1 02, 112) est decate des elements de detection tfimage pour R (101 T 111) et B (103, 113) de 

Ph/2 et Pv/Z respecuVement. dans la direction horfcontate et dans la direction verticale. 



so 



35 



40 



45 



50 



55 
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FIG. 3 
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FIG. 5 
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